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We explore the interplay of network structure, topology, and dynamic interactions between nodes 
using the paradigm of distributed synchronization in a network of coupled oscillators. As the network 
evolves to a global steady state, interconnected oscillators synchronize in stages, revealing network's 
underlying community structure. Traditional models of synchronization assume that interactions 
between nodes are mediated by a conservative process, such as diffusion. However, social and 
biological processes are often non-conservative. We propose a new model of synchronization in a 
network of oscillators coupled via non-conservative processes. We study dynamics of synchronization 
of a synthetic and real-world networks and show that different synchronization models reveal different 
structures within the same network. 
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Community structure is an important characteristic of 
complex networks, including biological and social net- 
works which are composed of functional modules or 
groups of similar individuals [TJ [2] . Existing algorithms 
examine connectivity, or topology, of the network to par- 
tition it into communities [3,-^. However, community 
structure of real-world networks is the product of both 
their topology and function^ which is determined by dy- 
namic processes taking place on the network. These pro- 
cesses are mediated by interactions between nodes, and 
they determine the phenomena taking place on the net- 
work, whether diffusion and other types of transport in 
biological networks, or epidemics and information spread 
in social networks. While it is generally accepted that 
network structure affects the evolution of dynamic phe- 
nomena [6, 7 , the impact of dynamics on our understand- 
ing of structure is less appreciated. As we show in this 
paper, different dynamic processes running on the same 
network can lead to different views of network structure. 

We explore the connection between network structure, 
topology and dynamic processes by studying synchro- 
nization in a network of coupled oscillators. Kuramoto [8] 
introduced a simple model of distributed synchronization 
that was adapted to networks of oscillators whose phases 
are coupled to their neighbors' phases |7l|9]. These sys- 
tems demonstrate an interesting connection between dy- 
namics and structure: as the network evolves to a steady 
state, oscillators belonging to different communities syn- 
chronize in stages, revealing the network's hierarchical 
community structure [lOl [11] . 

Oscillators in the Kuramoto model are coupled via a 
processes similar to diffusion, which we informally re- 
fer to as conservative. Such processes cannot describe 
interactions in real- world networks, which often have 
non- conservative nature, for example, due to dissipa- 
tion. To account for this, we introduce a new model of 
synchronization in a network of nodes coupled via non- 
conservative processes. We simulate the two types of 
processes in example networks: a synthetic network with 
a hierarchical community structure and a benchmark so- 



cial network. We show that dynamics of non-conservative 
synchronization reveals a community structure, but this 
structure is different from that found by the conservative 
Kuramoto model. This demonstrates the importance of 
dynamic processes in the analysis of network structure. 
We consider a network of N active nodes, each inter- 
acting locally with its neighbors. In the Kuramoto model 
nodes are oscillators coupled to their neighbors through 
the sine of their phase differences. The phase 6i of the 
zth oscillator evolves in time according to: 



dt 



■ Ui^ ^ KijSin{Oj - Oi) (1) 

j^neighb{i) 



where uji is the natural frequency of node z, and Kij 
is the coupling constant that describes the strength of 
interaction with neighbor j. For small phase differences, 
sinO ~ ^, the linear version of the Kuramoto model can 
be written in vector form: 



dO 
'dt 



K -LO 



(2) 



Here 6> is a vector of phases and uo natural frequencies 
of N oscillators, and if is a matrix of pairwise cou- 
plings constants between nodes. More generally, 6 can 
be some dynamic variable associated with the nodes. 
We represent the network as an unweighted, undirected 
graph, with an adjacency matrix A^ such that A[i^j] = 1 
if there exists an edge between nodes i and j; other- 
wise, A[z,j] = 0. The Laplacian matrix of the graph is 
L = D — A^ where D the diagonal degree matrix, such 
that D[i,i] = ^iA[iJ] = di and D[iJ] =0W i^ j. If 
nodes are identical, uJi = a; Vi, the network can reach a 
fully synchronized steady state in which Oi = \/i. 

A simple intuition for why the interactions in the lin- 
ear Kuramoto model may be considered conservative is 
as follows. Imagine that at time t, node i produces an 
amount diOi(t) of some quantity (e.g., chemical density) 
for its di neighbors. Each neighbor receives 1/di of this 
amount; therefore, interaction conserves the amount of 



quantity in the network. Interactions need not always be 
conservative. In some networks, the quantity created by a 
node (e.g., pathogen in a human population, light among 
fireflies) is not completely distributed among neighbors. 
Imagine now that node i produces an amount aOi of the 
quantity for its neighbors, regardless of the number of 
neighbors it has, but each neighbor receives an amount 
Oi. Therefore, {a — di)Oi of the quantity created by i is 
not transferred to any neighbor and is lost. This changes 
the nature of interactions and the resulting network dy- 
namics. A linear model of non- conservative interactions 
described above can be written as: 



dt 



jGneighb{i) 



di 



)> 
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Here a > Xmax is a constant, with Xmax the largest eigen- 
value of A. Equation [3] can be written in vector form: 
dO /dt = uj — K ■ {al — A)0^ where / is the identity matrix. 
The model above introduces a new operator, the Replica- 
tor operator R = al — A^ a. non-conservative counterpart 
of the Laplacian matrix, which governs the dynamics of 
the network. In spite of non-conservation, under condi- 
tions specified below, the system reaches a steady state 
where the dynamic variable no longer changes. 

Both conservative and non- conservative models are 
special cases of the generalized linear synchronization 
model, which can be written in terms of the operator 
jC{A) of the adjacency matrix A. 



d£ 
dt 



K • C{A)e 



(4) 



Each model encapsulates the details of interactions. For 
example, if the new amount of content produced by node 
i is 6i, instead of diOi in Eq. |2J the conservative synchro- 
nization model then leads to the normalized Laplacian 
/ — AD~^ rather than L. Solving Eq. [4] we get: 



o{t) = {Oo - {K • cy^cu)e-^-^' + {K • cy\ 



(5) 



with ^0 the initial phase of the oscillator at t = 0. 
Matrix C can written as an eigenvalue decomposition 

C = X]i=i ^[•,i]\^~^[h •]? where X is the matrix whose 
ith column is the ith eigenvector of C with eigenvalue A^. 
For uj = and Kij = c Mi^j^ Eq. [5] can be rewritten as: 

N 

e(t) = Ooe-'^' = ^A:[.,i]e-'^^'A:-'[i,.]Oo 

N 

= J2x[.,i]e-^^''ci (6) 

Here q = A'~^[z, .]^o is a constant. 

A non-trivial steady state 0{t -^ oo) 7^ exists when 
Ai = 0. Under this condition, Eq. [6]as t ^ 00 reduces to 
0^ = A'[.,l]ci, with constant ci. The steady state solu- 
tions of different synchronization models can be similarly 
found. 



C = D — A = L: In this case A'[., 1] = 1 (vector of Is). 
Hence, 6>| = 0\/ i^ i.e., all oscillators have the same 
phase in the steady state. 

C = I — AD~^: In the steady state, 91 oc d[i]^ where d[i] 
is the degree of node i. 

>C = XmaxI — A = R: In the steady state, 0^ oc eigenvec- 
tor of the adjacency matrix A corresponding to the 
largest eigenvalue. 

jC = al — AWa > Xmax- The steady state has a trivial 
solution Of -^ Oyi 

Hu et al. [12 studied dynamics of a network of nodes 
coupled via a signalling process, which can be described 
by an operator C{A) = {I-\-A). However, it can be shown 
that this system will never reach a steady state. 

The spectrum of the operator £ gives information 
about topological and temporal scales of synchronization. 
In the Kuramoto model, the time to reach steady state is 
inversely proportional to the smallest positive eigenvalue 
of the Laplacian, and gaps between consecutive eigenval- 
ues of the L are related to the relative difference in syn- 
chronization time scales of different communities [lOl [11] . 
While we have not fully explored the spectrum of R, it 
can be shown that time to reach the steady state is in- 
versely proportional to the smallest positive eigenvalue 

of i? (for a = Xmax)' 

While spectral analysis can illuminate some aspects of 
network structure, simulating dynamics of synchroniza- 
tion offers a more computationally efficient method to 
identify network structure. As demonstrated by Arenas 
et al. [10 , nodes in the Kuramoto model synchronize 
in stages, with smaller units synchronizing before larger 
units, etc., until the entire network becomes synchro- 
nized. These stages reveal the hierarchical community 
structure of the network. 

We quantify the degree of synchronization of nodes i 
and j at time t using similarity function: 



,{t) = cos{ei{t) 



m^ 



(7) 



where Of is the steady state phase of node i. The ratio- 
nale for this metric is that when nodes reach the steady 
state, further interactions should not change their phases. 
In the conservative case, all phases are equal in the steady 
state; therefore, Eq. [7| reduces to the order parameter 
Sij = cos{Oi{t) — Oj{t)) used in [10]. As nodes in the 
same community become more synchronized with each 
other, their similarity grows. Nodes are maximally sim- 
ilar {sij{t) = 1) in the steady state of both synchroniza- 
tion models. 

We explore the differences between dynamics of con- 
servative and non- conservative synchronization and the 
structures that emerge in two example networks. First, 
we consider a synthetic network with a fixed hierarchical 
community structure. While the synthetic network does 
not have the statistical properties of naturally evolved 
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FIG. 1. (color online) Analysis of the synthetic graph, (a) Hinton diagram of the adjacency matrix. A point is red if an edge 
exists between nodes at that location; otherwise it is blue, (b) Eigenvalue spectrum of the two operators. Similarity matrix at 
t — 1500 under the (c) conservative and (d) non-conservative synchronization models. Color indicates how similar two nodes 
are, with red corresponding to higher and blue to lower similarity. 



real- world networks, we study this case to demonstrate 
that imposing different dynamics on the same graph leads 
to measurable differences in the structures found by the 
two synchronization models. The synthetic network, con- 
structed following the methodology of [10 , has N = 256 
nodes evenly divided between four communities, with 
each community further sub-divided into four equal size 
sub-communities. Each node randomly connects to zi 
nodes within its sub-community, zi + Z2 nodes within its 
community, and Zout nodes outside the community. For 
our experiments, we took zi = 13, ^2 = 4 and Zout = 1- 
Figure Ilia) shows the hinton diagram of the adjacency 
matrix of this network, with red entries indicating the 
presence and blue the absence of an edge. Dense red 
blocks correspond to sub-communities at the first level of 
the hierarchy, and sparse red blocks to second level com- 
munities. The spectra of L and R operators are shown in 
Figure [ijb). Each spectrum contains the eigenvalues of 
the operator, ranked in descending order, with the largest 
eigenvalue in the first position. While there are already 
differences in the spectra of the two operators, these dif- 
ferences become more pronounced in real- world networks 
characterized by heterogeneous degree distribution. 

We simulate synchronization dynamics in the synthetic 
network by letting nodes' phases evolve from some initial 
configuration. We ran 100 simulations of each synchro- 
nization model with the initial values of Oi drawn from a 
uniform random distribution [— tt, tt] and coi = Vi, and 
<^ = ^max in the non- conservative model. Figure [ijc) 
and (d) show the similarity matrix of the network after 
t = 1500 iterations under the two models. The matrix 
represents similarity, s^j, of pairs of nodes, with color 
red corresponding to higher similarity values and blue to 
lower. The minimum similarity between any two nodes in 
the non-conservative system is 0.998, compared to 0.958 
for the conservative system. The hierarchical community 
structure is visible in both similarity matrices. 

To find hierarchical community structure of the syn- 
thetic network, we execute a hierarchical agglomerative 



clustering algorithm on the similarity matrix at some 
time (here, after 1500 iterations). This procedure pro- 
duces a dendrogram, which can be partitioned into four 
or 16 clusters. We use normalized mutual information 
MI to measure how well these clusters reproduce the 
actual communities [13]. When MI = 1, discovered 
clusters are the actual communities; while for MI = 0, 
they are independent of the actual communities. When 
we split each dendrogram into four clusters, we find 
MI = 1.00 for the conservative model, and MI = 0.83 
for the non- conservative model, while splitting it into 16 
clusters, MI = 0.66 (conservative) and MI = 0.96 (non- 
conservative). Non- conservative model appears to iden- 
tify smaller structures faster and more accurately than 
the conservative model. 

Next we study the real-world friendship network of 
Zachary's karate club ^, shown in Fig. |2|a), a widely 
studied social network benchmark. During the course of 
the study, a disagreement between the club's administra- 
tor and instructor resulted in the division of the club into 
two factions, represented by circles and squares, which we 
take as the actual communities for this network. There 
are greater differences between the spectra of L and R, 
shown in Fig. ^b), than for the synthetic graph with 
a more homogeneous degree distribution. The smallest 
positive eigenvalue of R is larger than that of L, imply- 
ing that the non-conservative model reaches steady state 
faster than the conservative model. Figure [2|c) and (d) 
shows similarity matrices after t = 1000 iterations of the 
two synchronization models. Minimum similarity in con- 
servative (non-conservative) model is 0.65 (0.91). 

We use a hierarchical agglomerative clustering algo- 
rithm to create dengdrograms of the network from the 
similarity matrices at different times. Both models re- 
veal rich hierarchical structure within the dendrogram, 
though the two dendrograms are very different. In the 
conservative model, high degree nodes (hubs) are deeper 
within the hierarchy, meaning they are more synchro- 
nized: 33 and 34, in one community and 1, 3 and 2 
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FIG. 2. (color online) Analysis of the karate club network, (a) Friendship graph, (b) Comparison of eigenvalues of the 
Laplacian and Replicator operators. Similarity matrix after 1000 iterations of (c) the conservative and (d) non- conservative 
synchronization models. Color indicates similarity of node pairs, with red corresponding to higher and blue to lower similarity. 
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synchronize earlier in the conservative model than the 
non-conservative model and remain more synchronized. 
Figure |3] reports MI scores of communities discovered 
by the two synchronization models at different times. 
The non- conservative model identifies communities faster 
than the conservative model, and the discovered commu- 
nities are purer. Under both models community mem- 
bership of nodes does not change after 3899 iterations. 
Similarity continues to increase until every node equally 
similar to every other node. 



FIG. 3. (color online) Normalized mutual information scores 
of the division of the karate club network into two groups by 
two synchronization models. 



in the other community. Peripheral nodes (such as 13, 
18, 22) synchronize later, although nodes 15 and 10 
never synchronize with their actual community and are 
mis-assigned. In the non-conservative model, periph- 
eral nodes synchronize first, while the hubs synchronize 
later. Bridging nodes connected to both communities 



In summary, our view of network's community struc- 
ture depends not only on how its nodes are connected but 
also on how they interact. We have explored this issue 
using models of synchronization in a network of coupled 
oscillators. Different interactions lead to distinct opera- 
tors that govern dynamics of synchronization, each with 
its own spectral properties and characteristic topologi- 
cal and temporal scales. In practical terms this suggests 
that to identify communities in real-world networks, al- 
gorithms have to take into account the nature of dynamic 
processes taking place on them. 
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